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PART  I 

SUMMARY  OF  AIR-TO-AIR  VISUAL  DETECTION  DATA 

BY 

MR.  A.  MILLHOLLON 

FEDERAL  AVIATION  AWGNISTRATION/sYSTEMS  RESEARCH  AND  DEVELOPMENT  SERVICE 

WASHINGTON,  D.  C. 

Introduction;  The  purpose  of  this  report  is  to  present  two  Control  Data 
Corporation  (CDC)  papers  summarizing  air-to-air  visual  detection  data.  This 
report  is  in  three  parts  with  Part  I  containing  introductory  remarks  and 
Parts  II  and  III  being  copies  of  the  original  CDC  papers  by  Mr.  J.  Lyons, 
and  Mr.  W.  Graham.  The  data  from  these  papers  are  an  output  of  the 
Federal  Aviation  Administration's  Pilot  Warning  Instrument  (PWl)  program, 
under  the  CDC  contract  DOT-FATOWA-2263 • 

Since  the  pilot  is  required  to  visually  detect  potentially  hazardous  intruders 
in  the  PWl  concept,  the  question  of  visual  detection  is  critical.  The 
significant  conclusion  from  the  data  presented  in  this  report  is  that  under 
good  Visual  Flight  Rule  (VFR)  conditions  if  the  pilot  is  given  accurate 
information  on  the  location  of  intruding  aircraft  he  has  a  high  likelihood 
of  seeing  the  intruder  in  sufficient  time  to  take  any  required  evasive  action. 

Discussion;  Of  the  several  concepts  being  considered  to  reduce  the  hazard 
of  mid-air  collisions,  the  Collision  Avoidance  System  (CAS)  is  probably  the 
best  known.  The  CAS  is  an  Instrument  Flight  Rules  (IFR)  device.  In 
operation  it  detects  the  intruding  aircraft  and,  through  pre-arranged  logic, 
displays  to  the  pilot  (in  a  timely  manner)  the  evasive  maneuver  he  should 
make.  With  the  CAS,  the  pilot  does  not  necessarily  see  the  intruder  he 
is  avoiding.  On  the  other  hand  the  FWI  is  a  VFR  device  that  locates  the 
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intruding  aircraft  and  indicates  to  the  pilot  where  to  look  to  find  the 
intruder.  It  is  then  up  to  the  pilot  to  assess  the  threat  and  take  the 
necessary  evasive  action.  For  this  reason,  the  ability  of  the  pilot  to 
visually  detect  other  aircraft  is  a  critical  factor  in  the  success  of  a  PWI 
as  a  collision  prevention  aid.  During  1969,  1971,  and  1972  the  FAA  had  the 
opportunity  to  collect  visual  detection  data  from  two  flight  missions.  The 
first  opportunity  occurred  when  the  Air  Transport  Association  (ATA) 
contracted  with  the  Martin-Marietta  Corp.,  Baltimore,  Md.,  to  flight  test 
experimental  CAS  equipments.  The  second  opportunity  occurred  when  the  CDC 
conducted  near-miss  photographic  missions  at  the  FAA's  National  Aviation 
Facilities  Experimental  Center  (NAFEC)  Atlantic  City,  N.  J.  In  each  of 
these  missions  two  or  more  aircraft  were  controlled  to  fly  near-miss 
encounters.  It  should  be  noted  that  PWI  equipment  was  not  installed  in 
either  aircraft.  In  the  ATA  tests,  the  pilot,  copilot,  and  observer  were 
maintaining  a  visual  search  for  the  target  aircraft.  For  the  photographic 
missions  run  by  CDC,  an  observer  (safety  copilot)  was  visually  searching 
for  the  target  aircraft.  The  paper  in  Fart  II  of  this  report  summarizes  the 
visual  detection  data  taken  during  the  NAFEC  photographic  mission.  The 
paper  in  Part  III  of  this  report  summarizes  the  visual  detection  data  taken 
during  the  ATA  CAS  tests . 

The  Lyons  paper  presented  in  Part  II  of  this  report  contains  approximately 
280  data  points .  As  mentioned  earlier,  these  data  were  taken  during  the 
air-to-air  photographic  missions  (typical  mission  Part  I  Fig.  l)  completed 
at  NAFEC  in  February  1972.  For  this  mission  the  desire  ana  procedures 
for  collecting  visual  detection  data  were  recognized;  consequently,  the  data 
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sample  is  larger  and  probably  more  accurate.  The  raw  data  from  these 
missions  are  shown  on  Tables  1A  through  IB,  Tables  2A,  through  2D,  and 
Table  3»  Tables  4,  5,  and  6  show  the  cumulative  probability  points 
derived  from  the  raw  data.  Figs.  1,  2,  and  3  are  simple  plots  of  the 
data  from  Tables  4,  5,  and  6.  At  this  point  it  is  well  to  turn  to  Part  III, 
Figure  2  of  the  W.  Graham  paper.  The  smooth  curves  on  Fig.  2  are  repres¬ 
entative  averages  from  Part  II,  Figs.  1,  2,  and  3*  They  were  put  together 
to  provide  a  quick  comparison  of  the  detection  range  characteristics  for 
various  aircraft  and  closing  speeds.  To  assist  ir.  interpreting  these  data, 
detection  ranges  were  converted  to  "Time  to  Closest  Approach"  by  dividing 
the  detection  range  by  xhe  closing  velocity  for  that  specific  encounter 
geometry.  While  this  calculation  is  only  valid  for  zero  miss  distances  the 
results  are  accurace  enough  to  provide  an  estimate  of  the  time  available 
to  a  pilot  to  assess  a  threat  and  take  evasive  action  if  necessary.  Part  I, 
Fig.  3  presents  the  cumulative  probability  of  detection  curves  with  an 
abcissa  scale  in  seconds. 

The  visual  detection  data  from  the  ATA  CAS  flight  tests  were  collected 
during  the  summer  and  fall  of  1969.  Approximately  40  observations  are 
recorded  in  the  W.  Graham  paper  (part  III) .  The  raw  data  are  listed  in 
Table  1  and  the  cumulative  probability  of  detection  derived  from  those 
data  are  shown  as  the  stair  step  curves  in  Figure  2.  To  give  the  reader 
some  insight  into  a  typical  aircraft  encounter  flight  a  sample  test  run 
is  shown  in  Part  I,  Figure  2.  A  primary  point  of  intei^st  common  to  all 
these,  data  is  that  the  pilot  in  all  cases  was  given  information  on  the 
location  of  the  intruding  aircraft.  This  information  was  based  on  radar 
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tracking  and  in  sonic  cases  based  on  the  CAS  equipment  range  and  range  rate 
readings.  An  assumption  applied  at  this  point  is  that  such  information 
approximates  the  performance  of  a  moderate  grade  FWI.  Therefore,  these 
data  imply  an  estimate  of  the  pilot  assistance  offered  by  a  moderate 
performance  PWI  system. 

Conclusion:  The  reader  is  cautioned  about  deriving  firm  conclusions  from 
these  data  since  there  were  limitations  in  running  these  experiments. 

There  was  a  small  cross  section  of  observers  which  may  not  accurately 
represent  the  pilot  population.  The  location  information  given  each 
observer  is  not  necessarily  representative  of  a  practical  PWI.  The  observer 
workload  level  probably  was  not  typical.  No  false  alarms  were  given. 

Traffic  conditons  were  light.  All  tests  were  conducted  when  visibility 
was  five  miles  or  greater  (good  VFR  as  opposed  to  marginal  VFR) . 

In  spite  of  the  above  limitations,  the  data  included  herein  give  an 
indication  of  the  potential  performance  of  pilots  aided  by  a  FWI.  It  is 
encouraging  to  note  in  Part  I,  Fig.  3  that  for  all  aircraft  with  the 
exception  of  the  Jet  Star  a  pilot  had  on  the  order  of  20  to  50  seconds 
minimum  and  50  to  90  seconds  average  to  make  an  evasive  maneuver  when  given 
representative  "PWI"  information. 

As  would  be  expected,  larger  aircraft,  given  the  same  closing  speed  as  a 
small  aircraft,  were  more  readily  detectable.  For  small,  fast  ,jets  in 
head-on  encounters  there  was  a  significant  probability  that  even  with 
PWI  information  the  pilot  did  not  see  the  intruder,  as  evidenced  by  the 
maximum  cumulative  probability  of  0.82  at  zero  time.  However,  we  do  not 
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have  a  record  of  the  miss  distance,  and  this  figure  may  be  pessimistic. 

In  cases  where  the  observer  did  see  the  small  jet  his  average  time  to 
react  was  30  seconds. 

Using  these  data  as  a  check,  the  FAA  FWI  program  will  include  several 
visual  d  tection  simulation  experiments  at  the  Department  of  Transportation's 
Transportation  Systems  Center  (TSC),  Cambridge,  Mass.  It  is  expected  that 
the  limitations  described  above  can  be  evaluated  during  these  simulations 
and  that  final  data  representative  of  practical  FWl/Pilot  situations 
will  result.  With  these  data,  it  is  expected  that  the  FM  can  closely 
estimate  the  benefit  which  can  be  derived  from  various  FWI  systems. 
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INTRODUCTION 


One  task  on  this  contract  has  been  to  design  and  photo¬ 
graph  flights  at  NAFEC  to  obtain  film  for  a  later  simulation. 
These  flights,  which  were  completed  in  mid  February,  1972, 
included  150  missions  during  which  two  aircraft  set  out  on 
collision  and  near-miss  courses.  In  addition  to  the  photog¬ 
raphy  in  each  run,  we  also  recorded  the  time  and  range  of 
first  visual  detection  of  each  aircraft  by  the  crew  of  the 
other  aircraft.  The  note  below  summarizes  this  data  in  tables 
and  figures. 


NOTES 


1.  In  the  tables  NC  signifies  no  visual  contact  during  that 
run,  NR  means  we  have  no  reliable  data,  RVD  denotes  the 
estimated  range  of  first  visual  detection,  D  indicates  the 
estimated  miss  distance,  and  S,R  denotes  i-he  flight  and 
film  Set/Run. 

2.  The  indicated  run  codes  refer  to  specific  encounter  geom¬ 
etries  which  are  described  in  another  report.* 

3.  In  all  runs,  detection  in  the  Aztec  was  by  the  co-pilot 
who  had  no  other  workload. 

4.  in  each  aircraft  the  crew  was  informed  of  the  run  Geom¬ 
etry  and  the  clock  position  of  the  other  aircraft. 

5.  Approximately  8C%  of  the  runs  were  conducted  under  scat¬ 
tered  clouds  with  visibility  in  excess  of  10  miles. 

6.  For  the  curves  of  detection  probability,  we  used  only 
those  cases  for  which  R^  >  2D. 

7.  All  runs  were  designed  with  the  Musketeer  (the  target 
aircraft)  within  ihe  y:30  to  12:00  o'clock  sector  of  the 
Aztec  (the  camera  aircraft).  Witn  respect  to  the  Musket¬ 
eer,  the  Aztec  position  varied  from  12:00  to  6:00. 


*  Lyons,  J. ,  "Phase  II  Photographic  Flight  Plan",  Control  Data 
Corporation,  Report  No.  CDC-JL-5  under  Contract  No.  DOT-FA- 
70WA-2263. 
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In  all  runs  the  aircraft  were  separated  by  500  feet  in 
altitude . 

Although  many  variable  factors  influenced  the  visual  de¬ 
tection  ranges,  we  have  made  no  attempt  to  isolate  these 
factors  and  correlate  them  with  the  results.  We  list  the 
major  factors  below: 

(a)  Flight  profiles  were  selected  to  ensure  that  the 
sun  was  not  within  the  f ield-of-view  of  the  camera, 
and  this  also  ensured  that  it  never  appeared  in  the 
vicinity  of  the  Musketeer  clock  position.  The  re¬ 
verse  was  not  true  and  the  Musketeer  on  several  oc¬ 
casions  had  to  search  for  the  Aztec  in  the  vicinity 
of  the  sun. 

(b)  The  Aztec  was  more  detectable  against  a  white  cloud 
background  than  against  an  ocean  background.  The 
reverse  was  true  for  the  Musketeer.  (About  half  of 
the  runs  were  conducted  with  the  Aztec  above  the 
Musketeer.) 

(c)  The  Aztec  was  often  at  unfavorable  clock  positions 
(3:00  to  6:00)  for  detection  by  the  pilot  in  the 
Musketeer. 

(d)  There  was  considerable  variation  in  the  vision  of 
four  different  co-pilots  in  the  Aztec. 

(e)  With  winds  the  crab  angle  in  the  Musketeer  altered 
the  clock  position  at  which  he  could  expect  to  ob¬ 
serve  the  Aztec.  This  was  not  the  case  with  the 
Aztec  because  our  flight  control  always  maintained 
the  Musketeer  at  the  correct  clock  position  with 
respect  to  the  Aztec  heading. 

Tables  1,  2,  and  3  g:ve  the  estimated  range  at  the  time  of 
first  detection,  RVD .  Tables  4,  5,  and  6  show  the  calcu¬ 
lation  of  the  cumulative  probability  of  first  detection, 
PD,  as  a  function  of  range.  This  probability  gives  the 
percent  of  targets  which  were  detected  by  a  given  range. 
The  runs  have  been  divided  into  groups  based  on  closing 
speed  in  making  this  calculation.  Consider  as  an  example 
the  left  hand  block  in  table  4  which  summarizes  detection 
of  the  Musketeer  by  the  co-pilot  of  the  Aztec  for  the  21 
runs  with  closing  speed  in  the  interval  33  -  100  knots 
(and  with  relative  heading  in  the  interval  0  -•  45°)  .  ihe 
Musketeer  was  detected  in  everyone  of  the  21  runs  so  the 
cumulative  probability  of  detection  reaches  unity  at  the 
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smallest  range  of  first  detection,  1.2  nmi.  The  great¬ 
est  range  at  which  the  target  was  first  detected  was  8.9 
nmi  at  which  point  the  cumulative  probability  of  detec¬ 
tion  equals  1/21  =  0.048;  that  is,  one  of  the  21  targets 
was  first  detected  at  this  range.  Another  target  was 
first  detected  at  8.0  nmi,  so  that  two  targets  were 
detected  by  this  range;  therefore,  PD  =  2/21  =  0.095, 
etc.  Figures  1,  2,  and  3  present  these  data  as  smoothed 
curves  and  illustrate  the  general  result  that  the  cumula¬ 
tive  probability  of  detection  decreases  with  increasing 
closing  speed. 


ft 


r  'if 


pw*»<rw  JRTy 


OS  Q 
«>  Q 
A  X 


X  Q 

->  a 
in  x 


X  c 

a 

in  c: 


as  Q 

->  Q 

in  os 


as  a 

«>  Q 

in  a: 


os  n 

->  Q 

A  X 


x  n 

->  Q 

in  as 


os  Q 
->  o 
in  as 


as  Q 
->  a 
in  as 


cm  ro  cm 

►  •  • 

CO  ID  O 
rH 

c\j  r*  ro 

►  •  i 

<J\  ro  O 

rH 

r-  o  cm 

►  I  I 

CM  CO  O 
CM 

rH  CO  CM 
»  •  • 
Tf  f\J  O 
rH 

CM  H  rH 

►  I  I 

00  ro  o 

ro  ON  CM 

►  •  1 

O  CO  o 

rH 

id  &  in 

►  I  I 

in  in  rH 

rH 

CM  00  CM 

►  I  I 

CM  ro  O 

CM 

■H  CT>  00 

t"  co  f' 

rH  CO  CM 

h  00  m 

i"  id 

rr  f~  cm 

O  CM 

►  i  ♦ 

►  *  • 

►  I  I 

►  •  I 

►  I  I 

cm  cm  o 

(\i 

ro  co  o 

rH 

<T\  ro  O 
rH 

00  CM  o 

vDno 

M*  m  o 

rH 

O  rH  o 

CM 

HOfO 

Tf  in  x 

(0  00 

M*  CM 

in  o  ^ 

HO't 

in  o  on 

“  •  « 

**  •  2 

►  I  I 

*  •  z 

rH  •  • 

►  i  • 

00  CM  O 

rH 

-?  rH 

>  r-  rH 

CM  00 

lO  U5  ^ 

•‘CM  O 
in 

co  in  o 

O'  cm  O' 

rH  IT  rH 

cm  ro  ro 

ITIHO 

rtOCO 

H  O  O 

ID  00  ro 

H  O  in 

•*  •  • 

r  i  « 

►  it 

►  i  • 

►  •  • 

►  I  1 

►  I  I 

►  •  I 

O  rH  O 
rH 

O'  rvi  o 

O'  ^  ro 

rH 

r-  id  cm 

CM  rH  O 

IT)  00  rH 

in  rH  o 

ro  id  O 

DETECTION  OF  MUSKETEER  BY  CO-PT.LOT  IN  AZTEC 


DETECTION  OF  MUSKETEER  BY  CO-PILOT  IN  AZTEC 


a  a 

->  Q 

M  O' 


a.  a 

->  Q 

tn  o' 


a  a 
->  a 

00  O  in 

to  at  it. 

^  t~-  in 

O  in  ro 

tn  K 

WHO 

f~  o  o 

moo 

“O  o 

pH 

pH 

in 

a  a 

t"  o 

rH  00  in 

m  u  at 

CM  U  ^ 

on  in  in 

->  Q 

•  o 

*2  • 

*z  • 

to  cc 

00  ro 

(MHO 

"0  o 

pH  pH 

in  o  o 

pH 

rH 

pH 

a  a 

O  Tf 

in  (?>  on 

\D  m  h 

tJ  tOtf 

in  <r» 

r-  r-  ro 

CM  ^  tfr 

in  in  cm 

->  Q 

f~*  u  • 

•*  4  • 

•*  i  * 

►  •  I 

*  i  « 

to  a 

“2  rH 

<M  O'  <\l 

to  'J  rH 

in  cm  o 

to  o  o 

ro  ro  O 

mmh 

rH  rH 

r- 

pH 

a  a 

rH  in  00 

ON  ID  CM 

(MO  K 

ro  to 

ro  rH 

rH  X  O 

m  at  in 

rH  U  tO 

CM  CM  ro 

->  a 

*  •  2 

*  •  • 

rH  •  • 

►  •  1 

'-2  • 

A  •  • 

to  OC 

O  H  O 

t-  <\l  rH 

OJ  CM 

to  r-  h 

in  (\i  o 

•‘CM  CM 

m  rH  O 

r~  h 

tJHO 

H 

at 

to 

to 

Id 

>  05 

o 

o 

o 

o 

in 

in 

in 

in 

in 

'  o 

cr. 

Ot 

at 

Ot 

• 

• 

A 

ro 

Id 

ro 

cm 

CM 

CM 

pH 

Q 

rH 

rH 

pH 

pH 

pH 

rH 

pH 

pH 

to 

Eh 

r- 

to 

to 

at 

at 

at 

at 

ro 

ao 

CO 

00 

O' 

at 

pH 

pH 

CM 

CM 

vr 

>  2 

rH 

pH 

pH 

pH 

C\J 

CM 

CM 

CM 

CM 

z  u 

< 

< 

< 

< 

< 

< 

< 

< 

< 

5  a 

in 

r- 

pH 

r- 

pH 

r- 

pH 

to 

pH 

os  o 

1 

i 

i 

i 

i 

t 

i 

1 

i 

u 

X 

X 

H 

H 

•o 

5x5 

X 

a 

DETECTION  OF  MUSKETEER  BY  CO-PILOT  IN  AZTEC 


S,R 

RVD 

D 

**  CM  OJ  | 

OJ  OJ  O 
oj 

S,R 

RVD 

D 

ro  in  m 

**  •  • 

OJ  rH  O 

OJ  ) 

S,R 

RVD 

D 

OOIM 

i-g  •  • 

*-(H  O 

i — I 

cm 

S,R 

RVD 

D 

<0  O  OJ 

*>  •  • 

O^HO 

rH 

S,R 

RVD 

D 

<o  ro  o> 

ro  o 

rH 

S  ,R 
RVD 

D 

•  II 

ro  HH 

rH  j 

a.  Q 
->  Q 
c/l  X 

in  co  o  oj  o  oj 

•  II  •  I  I 

rH  Tf  rH  OJ  OJ  rH 

rH  rH 

S,R 

RVD 

D 

o  cc  o>CMin  in  eg  r-i  10  <N  in  UO 

*  •  2  »  •  •  ►  ■  •  »2  •  ►  •  • 

rim  rtrlO  CO  O  O  O  r-i  O  CM  CO  WOO 

,-g  cm  cm  i-t  cm 

S,R 

RVD 

D 

mmm  m  o>  .-g  ro  co  co  io  o  cm  mine  mum 

•  ■  •  •  »  •  •  *2  •  “2  • 

H<N|(M  OOHO  COOO  CO<fO  CM  eO  CM  o 

rH  rH  rg  CM 

S ,  R 
RVD 

D 

**  mm  r~  o  o  0000  mom  eg  cm  O'*  t~  u  m  noon 

•  •  1  r  1  ■  >  •  ■  ►  ■  1  r  1  1  »2  1  ►  •  • 

nmn  iC'rHrH  mno  co  h  0  oho  cn  O'mn 

M  CM 

S,R 

RVD 

D 

ro  u  m  0  m  O'UO  n  k  in  ^  u  N  rocoH  O  0>  O  cj  h  h 

•>2  •  •  1  •  **2  •  *2  •  ^ 2  •  ►  •  •  •  •  •  •  •  • 

O'  H  O'Mtrl  in  rH  OJ  O  <D  OrHrH  O^OJOJ  0><MOJ 

OJ 

•  ! 

DEGREES 

135 

13i 

157.5 

157.5 

157.5 

157.5 

157.5 

180 

VR 

KNOTS 

243 

254 

259 

270 

270 

270 

270 

275 

RUN 

CODE 

L-7A 

M-1A 

N-1A 

0—1 A 

0-4A 

0-7  A 

0— 8A 

Q-4A 

Id 

CO 

< 


I 

t 

! 

' 


i 

i 


7 


n i nfc^n'-^ r  nr-i 


fnrt#r 


DETECTION  OF  MUSKETEER  BY  CO-PILOT  IN  AZTEC 


«  q 
->  a 
to  at 


ct  a 
«>  a 
to  ee 


Ct  Q 
->  Q 
tO  O' 


O'  Q 
->  Q 
tO  Ct 


o s  a 
->  a 
to  ct 


ct  Q 

->  Q 

to  ct 


ct  a 
~>  Q 
tO  Ct 


ct  a 
->  a 
to  a: 


ct  Q 
->  Q 
to  on 


ct  Q 
->  Q 
tO  Ct 


ct  a 

->  Q 

to  Ct 


(M  ro  CM 

00  rH  o 

rH 

CM  a)  ro 

on  ^  o 

rH 

o  CM 

•*  •  • 

CM  UO  O 
CM 

•H  ro  CM 

fM  ITI  rH 

ro  UO  CM 

VO  U  UO 

CM  VO  CM 

•>  •  i 

^  •  • 

~2  • 

“  •  • 

^  CM  O 

00  to  c 

O  00  o 

U0  rH 

CM'f  o 

rH 

rH 

rH 

CM 

H  O  00 

r-*  on  r* 

rH  V£>  CM 

HrllM 

r-  5j*  uo 

CO  ^  CM 

tf  in  cm 

•  • 

•*  •  i 

•*  •  • 

•*  •  • 

•*  •  • 

CM  rH  O 

ro  ro  O 

ON  UO  O 

CO  CM  o 

UO  ro  O 

O'  CM  O 

O  tf  o 

CM 

rH 

rH 

rH 

CM 

.H  in  co 

'fa  E 

to  oo  oo 

'V  ct 

inrjh 

rH  O  CO 

U0  O  00 

CM  O  CM 

-Z  Z 

•*  «  • 

*  •  2 

-z  • 

rH  •  • 

•*  i  i 

CO  H  o 

r-  ro  rH 

CM  00 

S 

4 

•■to  o 

CO  CO  O 

O  tf  o 

rH 

UO 

rH 

Tt  ro 

ninn 

cm  ro  ro 

U0  rH  o 

•H  Ct  00 

H'JO 

to  00  ro 

rH  U0  U0 

rH  CM  O 

•*  •  • 

•»  •  • 

•*  •  • 

-2  • 

•  1 

•*  •  • 

•*  *  • 

•»  •  • 

O  rH  O 

'fHO 

^  ^  'O 

r-  uo  cm 

CM  O 

UO  CM  rH 

U0  rH  o 

CO  rH  O 

ON  O'  CO 

rH 

rH 

uo 

UO 

lO 

UO 

UO 

o 

• 

• 

• 

• 

• 

UO 

UO 

uo 

CM 

CM 

CM 

CM 

CM 

•t 

•f 

CM 

CM 

CM 

CM 

CM 

ro 

rH 

rH 

rH 

ro 

ro 

rH 

o 

o 

ro 

UO 

UO 

UO 

to 

VO 

o 

rH 

rH 

rH 

rH 

rH 

< 

< 

< 

< 

< 

< 

< 

< 

< 

CM 

rH 

CM 

rH 

VO 

rH 

rH 

CM 

i 

i 

i 

i 

l 

1 

l 

i 

i 

< 

m 

CQ 

CO 

u 

u 

a 

u 

u 

DETECTION  OF  AZTEC  BY  CREW  OF  MUSKETEER 


TABLE  2B 

DETECTION  OF  AZTEC  BY  CREW  OF  MUSKETEER 


S,R 

RVD 

D 

a :  a 

oo  r-  tsj 

->  a 

•  1  I 

V}  a 

rH  rH  O 
CM 

x  Q 

^  in  o 

->  Q 

•  •  • 

A  X 

O  rH  rH 

CM 

x  a 

00  O  CM 

->  D 

*>  I  I 

W  £T 

O'  rH 

rH 

K  Q 

O'  O  00 

->  Q 

•  1  I 

O  K 

Own  o 

rH 

a  a 

co  o  m 

vO  on  in 

->  Q 

*•  •  • 

•>  I  I 

W  X 

r'  Nf  h 

moo 

rH 

rH 

ce  a 

t~-  o  in 

LO  LO  CO 

Mno 

in  co  vd 

in  co  o 

->  Q 

•*  •  • 

^  I  # 

•  •  • 

•  •  • 

•  •  • 

A  X 

WHO 

O'  cm  o 

f-  CM  rH 

Nf  HO 

rH  rH  rH 

rH 

rH 

rH 

rH 

rH 

x  a 

oo  o  m 

«o  m  m 

^  in 

O  O  m 

T  in  x 

->  a 

►  •  • 

•*  •  • 

•  •  • 

rH  •  • 

•*  •  2 

A  X 

00  rH  O 

r-  cm  o 

moo 

*-ro  o 

rH  CO 

rH 

rH 

in 

rH 

X  Q 

1"  o 

rH  o  m 

ro  cnj  O' 

CM  ^ 

O'  o  co 

co  u  m 

~>  Q 

~  •  o 

*••• 

•  I  • 

•  •  • 

•  •  • 

-z  • 

A  X 

CO  rH 

CM  rH  O 

COHO 

rH  rH  rH 

in  co  o 

rH  CM 

rH 

rH 

rH 

rH 

x  a 

OUT 

mao; 

OUt' 

vf  IT) 

in  in 

r-  CM  CO 

CM  r" 

in  u  cm 

'Tom 

►>  Q 

H  2 

• 

-2  2 

-2  • 

•'ll 

“  I  1 

•  •  • 

••  •  • 

•*2  • 

•  I  I 

A  X 

•» 

rH 

r\j 

<£>  rH 

LT>  v£)  O 

lO  lO  o 

co  co  O 

t~-  rO  rH 

If  rH 

f-  CM  rH 

rH 

X  Q 

O'  KO  CM 

CM  U  X 

co  in  o 

CO  CO 

rH  CM  O 

co  cm  in 

rH  CO  ^0 

cm  in  co 

CO  rH  in 

~>  Q 

•»  • 

t 

-2  2 

•*  •  • 

•*  •  • 

rH  •  • 

•  •  • 

•*  •  • 

•*  •  • 

A  X 

r-~  m 

rH 

CNJ 

lO  CM  rH 

moo 

••CM  CM 
O' 

co  co  o 

CM  rH 

'TOO 

r  Nf  h 

in 

u] 

O 

o 

o 

LO 

in 

in 

in 

in 

in 

td 

ON 

ON 

ON 

• 

• 

• 

• 

co 

co 

CM 

CM 

CM 

CM 

rH 

rH 

V  o 

rH 

rH 

rH 

rH 

u 

rH 

rH 

rH 

rH 

Q 

in 

H 

U> 

NO 

ON 

ON 

O' 

ON 

co 

co 

KO 

CO 

ON 

ON 

rH 

rH 

CM 

CM 

>  2 

rH 

rH 

rH 

CM 

CM 

CM 

CM 

CM 

CM 

b£ 

2  U 

tf4 

< 

< 

< 

< 

< 

< 

< 

< 

2  a 

r- 

rH 

t- 

rH 

r" 

rH 

NO 

rH 

r" 

2  O 

i 

i 

i 

i 

i 

i 

1 

i 

i 

u 

X 

H 

H 

*-> 

2 

•j 

u 

r\j 


id 

CQ 

< 


1C 


/? 


WiTilfi'i'a'iTfff'ii 


DETECTION  OF  AZTEC  BY  CREW  OF  MUSKETEER 


Pn  VS  R  FOR  AZTEC  DETEC" ION  OF  MUSK  1TEER 


0 

1 

c 

V 

X 

0 

u 

O 

a. 

in 

00 

in 

c~ 

rH 

■P 

<M 

c 

0 

•H 

0 

4J 

0 

■P 

o 

0. 

a> 

m 

'O 

<M 

rH 

4.1 

<M 

rH 

'J 

Q 

V 

1 

1 

o> 

o 

c 

1 

1 

<M 

iti 

sa 

in 

■p 

0 

c 

V 

X 

~  u 

0 

W  Q, 

0\ 

m 

■P 

rH 

rH 

c 

<M 

rH 

•H 

0 

0 

0 

a 

■P 

4J 

<T5 

r- 

• 

4J 

00 

O 

0J 

rH 

0> 

a 

(0 

■P 

0 

c 

TJ 

X 

~  U 

m  ch 

vo 

0 

■P 

in 

00 

c 

rH 

VO 

iH 

0 

0 

0 

a< 

■P 

4J 

10 

O 

0 

■P 

rH 

in 

It) 

r-1 

a 

I  I  r- 

rH 

i  i  — 


n 

a 

4J 

• 

C 

in 

•H 

0 

a- 

0 

■P 

4J 

O 

ftJ 

Q 

a) 

1 

O' 

rH 

c 

1 

Pd 

ifl 

'w' 

os 

ooooooooooocooo 

inominoinominoinooino 

OOOOOOOOOOOOOOH 


inoocoot'-omcnoMOinrotMOin 

•  •••••••••••••• 


oooooooooooooooooo 

inoinoinoinoininoomoinomo 

OrHrHcgrMfOfO'sj'^'mvor-r-flOOOO'O'O 

OOOOOOOOOOOOOOOOOrH 


E£g 

c  c  c 


iiiiiiiiiii' 


a>vD<y>HOOr~uifOiHOOMoroi-iooor~o 

•  ••••••••••••••••• 

ffvr-TT'>3,rorororomrofMf\j(McM<MrH^H 


i/)HM»io>inHt'noO’tioooo 

OHrHf\irMfO'«t^,ininv£)r-coo 

OOOOOOOOOOOOO.H 


t*  *rl  *rl  *rl  -H  H  "H  *H  tI  M  v]  <1  ri  ■rl 

EggEEgEggggggg 

cccccccHcccccc 

t'OfMOf'IOOOt'IOrlOMflOMS 

•  ••••••••••••• 


UOinfOrHOOVOrHVOfOrHONOrHOinrHO 

ryav^orooooor-cMr-rHvovOrHomo 

OCHi-ir\ic\jfo«<i,ininioiof'-ooa>0>o 

OOOOOOOOOOOOOOOOH 


o\or'TOHOMor'-^,rHoa>oomoa><\i 

0000>V£)VOmmfOfOfOfOf\lrMfMfMrHrH 


n 

-P 

0 

c 

• 

O 

w 

in 

00 

4-> 

r-v 

H 

C 

<\J 

•H 

0 

0 

0 

■P 

Dj 

-p 

0 

fd 

CO 

in 

4-> 

ro 

m 

CM 

rH 

Q 

1 

1 

00 

rH 

1 

1 

K 

> 

y 

rHfNJoounoinrHt^fsjoofnoino 

rHCMt^TfOvnrHCOCMf-rOaWO 

Ht'jfMnfinuiuj^t'Mxjcoo'O 

•  •«••••••••••• 

OOOOOOOOOOOOOrH 


EEEEEEEEE 

CCCCCCCCC 


E  E  E 

e  e  c 


Hicinoou'NHOiflinnoin 


on  ro  to 


0  0  0 
■P  4J  a 

VO  c  (0 

0N  a  -P 

rH  ON  ffl 

a 


ONOOvO'frroovDlOO 

uir-Ht'-ONinr'Ovoo 

OrHrHfNjrO'Vj't^t^O 

OOOOOOOOH 


EEEEEEEEE 

CCCCCCCCC 

voinooi^ojinr-o 

•  •••••••• 

vDvflin^fnflcjHH 


r"  «  w 

CO  0  -P 

rH  On  c 

•H 

ooo 

-p  -p  a 


i  i 

ro 

I  I  CM 


^fr'OrH^fQOCMincocMvno'VDOravoc^o 

NfCOrUDONfOinr'tNUOOC'NfoOtNuno 

oOrHCMromn^f^ininvovct^i^oooNO 

OOOOOOOOOOOOOOOOOrH 


**H  **H  *H  »*H  *ri  »»H  *H  *H  *H  fH  *H  *H  »rl  *H  *H  »H  »H  »H 
EEEEEEEEEEEEEEEEEE 
cccccceccccccecccc 

t^rofNJvoincMrHovootnrocNjor'Lnnvo 

.ll/lUlvfvfCfNfVfnfOCNItNJAKMrtHHO 


Knots 

rH 

• 

in 

■p 

o 

ID 

c 

rH 

•H 

0 

0 

0 

a. 

■p 

4J 

ro 

« 

m 

4J 

ro 

O 

m 

1 

1 

1 

1 

Q 

ON 

rH 

K 

> 

V 

wr 

rOLnrHmvOCOrHrrvOrH^r~OLnO 

inOrHVOrHVOCMr'CMCOCOrOONONO 

OrHCMCMCrim^r^rinvOVOC^f-COO 

•  •••••••••••••• 

OOOOOOOOOOOOOOrH 


fH*H*»H*»H*H*H*rl»rl'»H*tH'rH'»H*»H*r(*H 

eeeeeeeeeeeeeee 

ccccccccccccccc 

ininovDrHCOO>co^r^rrnrHoOLnro 

COvDVDl^in^fnmrOCMCMfNJHHH 


TABLE  6 


SUMMARY  OF  VISUAL  DETECTION  DATA 
TAKEN  DURING  THE  ATA/CAS  FLIGHT  TESTS 


Contract  No.  DOT-FA-70WA-2263 


Mr.  W.  Graham 
Control  Data  Corporation 


Submitted  to: 

Federal  Aviation  Administration 
800  Independence  Avenue 
Washington,  D.  C. 

Submitted  by: 

Control  Data  Corporation 
Advanced  Studies  Laboratory 
4201  Lexington  Avenue  North 
St.  Paul,  Minnesota 


Date:  1  May  1972 
Author:  W.  Graham 


SUMMARY  OF  VISUAL  DETECTION  DATA 
TAKEN  DURING  ATA/CAS  FLIGHT  TESTS 


Introduction 

During  the  last  few  weeks  of  flight  testing  of  the  ATA/ 
CAS  equipments  by  the  Martin  Marietta  Corporation,  the  FAA  supplied 
observers  to  record  data  concerning  the  range  of  visual  detection.. 
Because  of  the  near-collision  geometry  of  the  runs  and  the  presence 
of  the  CAS  equipment,  which  gave  a  precise  measure  of  the  range 
between  the  aircraft,  these  tests  were  an  ideal  opportunity  to 
make  such  observations.  Details  of  the  equipment  flown  and  a 
summary  of  each  flight  are  given  in  Reference  1. 

In  the  interest  of  safety  no  runs  were  made  when  the 
air-to-air  visibility  was  estimated  to  be  less  than  five  miles 
and  indeed,  out  of  a  total  of  43  runs  observed,  the  range  from 
the  observer's  aircraft  at  first  visual  detection  exceeded  five 
nautical  miles  79%  of  the  time.  One  would  infer  from  this  that 
first  detection  occurred  in  one  or  both  aircraft  96%  of  the  time 
beyond  this  range. 

Each  run  was  designed  to  test  some  feature  of  the  CAS 
equipment.  Four  aircraft  were  involved,  and  they  flew  a  wide 
range  of  speeds  and  relative  headings,  producing  a  range  of 
cloring  speed  from  50  to  900  knots.  The  runs  were  conducted  at 
small  altitude  differences,  in  order  to  produce  CAS  alarms. 
Geometrical  Considerations 

Since  the  range  at  first  detection  is  expected  to  be 
a  function  of  closing  speed,  an  estimate  of  the  closing  speed  was 
made  for  each  run.  There  were  three  different  ways  (potentially) 
of  making  this  estimate;  not  every  way  was  available  in  every  run. 
Figure  1  illustrates  the  source  of  these  estimates.  The  diagram 
on  the  left  represents  the  observer's  aircraft  at  point  0  and  the 
intruding  aircraft  on  a  relative  track  from  point  A  to  point  C, 
moving  with  the  relative  velocity  Vr ,  and  passing  at  a  distance  of 
closest  approach  d.  Nominally  the  runs  are  set  up  for  d  =  0,  but 
in  practice  the  miss  is  considerable;  the  minimum  separation  was 


not  recorded. 


The  diagram  on  the  right  in  Figure  1  illustrates  the 
range/time  history  of  a  typical  run  with  a  finite  miss  d.  If 
d  were  zero  Vr  would  pass  through  0  and  the  range  rate 
would  be  constant  over  the  run  and  equal  to  V  .  If  d  ^  0 
the  range  rate  decreases  as  the  point  of  closest  approach  C 
is  neared,  reaching  zero  range  rate  at  point  C.  At  ranges 
large  compared  with  d  there  is  little  difference  between  the 
actual  closing  speed  and  Vr;  the  nominal  V  was  recorded 
in  almost  every  run  but  it  can  be  expected  to  deviate  from  the 
actual  value  because  of  differences  in  actual  speeds  and  headings 
from  the  nominal  values.  This  nominal  value  of  Vr  is  one  of 
the  three  estimates  of  range  rate  available. 

The  CAS  is  designed  to  alert  the  pilot  to  prepare  to 
climb  or  descend  at  the  so  called  tau  2  warning  time  defined 
by  the  relationship: 


-  R. 


During  the  runs  observed  t 2  was  set  to  30  seconds,  and 


Rq  was  set  to  1.6  nmi. 


Solving  for  the  range  rate  R 


Rp  =  (Rp  -  1.6)  x  120  knots 
Rp  is  the  range  at  which  the  T2  alarm  is  triggered. 

It  can  be  seen  from  Figure  1  that  the  range  rate  Rp 
can  be  expected  to  be  somewhat  less  than  Vr  depending  on 
d  and  Rp.  It  is  also  subject  to  errors  in  its  measurement 
by  the  CAS  equipment,  but  it  affords  a  second  estimate  of  the 
closing  speed  in  each  run. 

The  CAS  is  designed  to  generate  a  command  for  climb 
or  descend  at  the  so  called  tau  1  warning  time  defined 
by  the  relationship: 


Ti  ■  V*c 

During  the  runs  observed  was  set  to  25  seconds.  This 

provides  a  third  estimate  of  closing  speed: 


R  R  x  144  knots, 

c  c 

The  tau  1  and  tau  2  alarms  can  also  be  triggered  if  the 
range  between  the  aircraft  is  less  than  0.6  and  2.3  nmi 
respectively.  In  that  event  the  range  rate  is  less  than  that 
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calculated  from  the  above  equations.  During  the  observations 
made,  the  range  alarm  was  only  triggered  when  the  indicated 
range  rate  was  in  the  lowest  speed  interval  so  that  the  dis¬ 
tinction  Y  2 tween  a  range  alarm  and  a  tau  alarm  has  no  effect 
on  the  data  reduction. 

The  Data 

Table  I  summarizes  the  observations  which  were 
made.  Generally  the  pilot  or  co-pilot  was  the  first  to 
observe  the  target;  occasionally  the  observer  did  so. 

The  range  at  visual  detection,  Ry  ,  which  appears  in  the 
Table,  is  the  range  at  which  the  target  was  first  sighted  by 
any  of  these  three  people.  In  some  cases  only  the  nominal 
relative  velocity  was  recorded;  in  others  all  three  estimates 
of  closing  speed  are  available.  Generally  the  three  estimates 
decrease  in  magnitude  in  the  expected  order:  Vr,  Rp  ,  Rc* 

The  estimate  Rp  was  always  used  when  it  was  available  since 
the  range  Rp  is  generally  closer  in  magnitude  to  the  range 
Rv  than  was  the  range  Rc  ,  and  hence  gives  a  better  estimate 
of  the  closing  speed  at  the  range  of  visual  detection  and  beyond 
it.  The  closing  speed  selected  for  sorting  the  data  is  indicated 
by  an  asterisk  in  the  tabulation  for  each  run. 

Four  different  aircraft  appeared  as  targets  during  the 
runs.  These  are  identified  by  three  numbers  (from  the  N  number) ; 
the  type  is  given  in  a  footnote  to  the  Table.  The  wingspan 
and  length  of  these  aircraft  are  given  in  Figure  2  . 

There  were  only  five  runs  with  either  of  the  two  jet 
aircraft  as  target  at  closing  speeds  below  460  knots  and  only 
one  run  with  a  404  target  at  a  closing  speed  above  400  knots. 

These  runs  have  been  eliminated  in  order  not  to  confound  target 
size  and  closing  speed.  The  runs  were  all  planned  without  regard 
to  the  angle  of  the  sun  with  respect  to  the  line  of  sight  from 
the  observer  to  the  target. 

The  results  are  summarized  in  Figure  2 , which  also  gives 
some  of  the  results  of  analysis  of  sightings  made  during  the 
recent  FAA/CDC  photographic  flight  test  program  reported  in 
Reference  2.  The  two  curves  summarizing  sightings  of  the  404 
aircraft  in  the  50  -  200  knot  and  200-400  knot  closing  speed 
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intervals  do  not  show  a  significant  speed  dependence.  The 
sightings  of  the  two  jet  aircraft,  all  in  the  460  -  900  knot 
closing  speed  interval,  were  at  significantly  shorter  ranges 
than  the  404  sightings  showing  a  combined  effect  of  target 
size  and  closing  speed  (  and  also  target  aspect) . 

The  data  reported  in  Reference  2  were  taken  under 
somewhat  different  conditions.  With  the  Gulf stream  and 
Musketeer  targets  the  sightings  were  made  by  one  observer 
who  had  no  task  other  than  the  detection  of  the  target* 
other  crew  members  said  nothing  if  they  detected  the  target 
first.  The  runs  were  planned,  for  photographic  reasons,  so 
that  the  sun  was  always  behind  the  observer.  In  the  runs 
with  the  Aztec  as  target, detections  were  made  sometimes 
by  a  pilot  alone  in  the  observing  aircraft  (a  Musketeer) , 
and  on  other  occasions  either  by  the  pilot  or  by  an  observer 
in  the  co-pilot's  seat.  The  sun  was  within  his  field  of  view. 

The  sightings  of  the  Gulfstream  compare  remarkably 
well  with  the  sightings  of  the  404  aircraft,  the  differences 
in  size  and  speed  being  small.  The  data  for  the  Aztec  and 
Musketeer  targets  show  detection  ranges  of  about  half  of 
those  recorded  with  the  larger  Gulfstream  and  404  targets. 

Discussion 

All  these  data  were  taken  under  conditions  of  good 
visibility  at  a  time  when  the  observers  knew  they  were  in 
a  near-collision  encounter  with  the  target  aircraft.  During 
the  ATA/CAS  tests  the  range  to  the  target  was  available.  In 
all  the  tests  summarized  in  Figure  2  the  observers  knew  approxi 
mately  the  relative  bearing  at  which  the  target  would  first 
become  visible.  It  is  impossible  to  give  a  firm  estimate  of 
what  the  uncertainty  in  angle  was.  If  the  range  at  first 
detection  was  short,  of  the  order  of  the  miss  distance,  the 
relative  bearing  could  be  considerably  removed  from  what  it 
was  at  the  beginning  of  the  run.  Such  experiences  would  have 
the  effect  of  expanding  the  field  of  search  on  subsequent  runs 
Our  guess  is  that  the  effective  width  of  field  was  something 
like  +  25°. 
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With  the  exception  of  nose-to-nose  encounters  with 
jet  aircraft  the  target  was  always  detected?and  when  detected, 
there  were  more  than  10  seconds  to  closest  approach  in  about 
99%  of  the  runs  with  small  targets  and  100%  of  the  runs  with 
larger  targets.  These  results  show  conclusively  the  signifi¬ 
cant  potential  of  PWI  devices  when  compared  with  Howell* s  data 
taken  with  pilots  who  did  not  know  they  were  flying  collision 
courses  (Reference  3);  see  also' Ref .4  for  other  closing  speeds. 

In  conditions  of  poorer  visibility  and  greater  work¬ 
load  in  the  cockpit  the  results  might  show  considerable  room 
for  improvement.  For  this  reason  we  hesitate  to  conclude  that 
the  dat »  supports  the  finding  that  the  presumed  accuracy  in 
relative  bearing  is  adequate. 
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